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About CD Projekt RED 

• Located in Warsaw, Poland 

• Established in 2002 

• Focused on RPGs 

• The Witcher (2007, MC:81) 

o PC, heavily modified Aurora Engine 

• The Witcher 2: Assassins of Kings (2011, MC:88) 

o PC, REDengine 1 

• The Witcher 2: Assassins of Kings Enhanced Edition (2012, MC:88) 

o PC/X360, REDengine 2 


* The Witcher 3: Wild Hunt 

o REDengine 3 

o Releasing in February 2015 
o PC/XBO/PS4 

• Cyberpunk 2077 (REDengine 3) 

o Release date TBD 
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The Witcher 3: Wild Hunt 


35x bigger than The Witcher 2 

• open world 

• complex streaming 

• a lot of tools refactoring 

• different approaches 

• DX9 -> DX11 




TERRAIN & 
VEGETATION 
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Agenda 

• How we deal with terrain 

o streaming and LOD 
o texturing 
o shadows 
o memory footprint 

• How we distribute vegetation and debris 

o on-the-fly distribution 
o offline vegetation generator 

• Stamp tool and workflow summary 

• Q&A 
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Terrain — Our objectives (1) 

• Support more than 16384 2 resolution maps 

• Less than 0.5 meter inter-vertex spacing 
•Various landscape characteristics 
•Terrain holes for placing cave mesh 

• Paint and fill it with a relatively small team 

o Terrain shape generated in World Machine and imported 
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Terrain — Our objectives (2) 

• Big expectations in terms of texturing 

o Nice material blends 
o Slope-based, per-pixel 
•Terrain must cast shadows 

• Extensive copy-paste functionality over general "landscape" 



GAME DEVELOPERS CONFERENCE* 2014 


Terrain - Streaming 

•Clipmap in memory, having regions 
streamed. 

o texture array 

• Working setup for Novigrad: 

o 46x46 tiles, 512x512 each (23552 2 ) 
o window res = 1024x1024 
o 5 clipmap levels 
o inter-vertex space = ~0.37 cm 
o ~74 km 2 
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Clipmaps 

• 3 streamed clipmaps 

o elevation (16 bit unorm) 
o control map (1 6 bit uint) 
o color (32 bit, reduced resolution 
-4096 2 in case ofa 16384 2 
elevation data set) 

• 3 runtime generated clipmaps 

o vertical errors (64x64 common 
case) 

o normals (optional) 
o terrain shadows 
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Terrain - Tessellation 

• Inspired by a Gpu Pro 3 article, 
similar technique applied to the 
clipmap 

• Triangle count still very good 

• Gives best results with max tess 
factors of 8 or 1 6, which is good 
especially for console GPUs 
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Vertical error maps generation 


For each tessellation block [x,y] 
(1 control point = 1 tess block) 



simpl = 0 simpl = 1 


calculate 


simpl = 2 simpl = 3 


maxVErrl maxVErr2 


maxVErr3 




vertical Error[x,y]. r g b 


vertical error clipmap window res = elevation clipmap window res / tessellation block res ( common case: 64 = 1 024 / 1 6) 
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Software tessellation 

• Downsample the error maps so we can simplify on a 
quad-tree level prior to relying on hardware tessellation. 

• Avoids rendering big areas with a dense grid of minimally 
tessellated blocks 
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Texturing goals 



WORKFLOW DESIGN ver.1.0 
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Texturing goals (2) 

• Have convincing vistas with virtually no effort 

o start the real work from there 

• Have nice material blends in closeup 

o fine to adjust texel size manually 
■ with UV-only brush 

• Simple to implement 

o No materials streaming 
o Just one texture array 
(two including normal map) 
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Texturing - Initial idea 

• Define a pair of default materials 

o Background and overlay 
o Set per game level 

o tangent of the background material normal defines visibility 
of the overlay material 

• Typical material layers on top of that 

o control MapVal <> 0 

• Unfortunately - far from achieving all three goals 
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Texturing - Solution 

• More radical approach - paint with two freely picked textures 
o Background texture (eg. rock) 
o Overlay texture (eg. snow) 
o Painting feels differently 

■ broom - when painting a pathway 

■ sowing tool - when placing grass 

■ a bucket of snow 


• 16 bit control-map 

o 0-4 overlay texture index 
o 5-9 background texture index 
o 10-12 UV scale (7 scale values) 
o 1 3-1 5 Slope threshold (7 threshold values) 
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Texturing — Slope threshold 

• Each of the 3-bit values assigned for slope threshold is associated with a value 

• Values go from 0.0 to 1 .0 

• Compute slope angle of the background material (world space texture normal) 

• Compare against threshold value (control map) 



0.125 


0.375 


0.5 


0.75 
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Texturing — Not enough flexibility 


• Issue with slope thresholds logic - 
problematic to make a thick 
snow/grass/sand/* cover 

• Start with simple ideas. . . 

• Boost overlay texture 
when vertex normal looks up 

• Might be good enough for this case, 
but ... 




GAME DEVELOPERS CONFERENCE* 2014 


MARCH 17-21, 2014 GDCONF.COM 


Cobblestones case 

• Bad for cobblestones :( 

• Smallest threshold value already makes it more than 50% covered 

• We want cobblestones to have wide range of protrusion 


slope threshold = 0.1 [proper distribution] slo P e threshold = 0.1 with boost [bad distribution] 
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Texturing — Solution 

• Provide some parameter that will save the day 

o “slope-based damp” 

• We can categorize background materials as: 

o artificial materials (cobblestone, brick, path) that appear mostly on horizontal surfaces 
o natural (crust, rock, etc.) ones that appear widely in nature 

• The parameter will be close to 0 for the first case and close to 1 for the second case 

• Do it separately for normals 
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Texturing — Dampening (3) 
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Texturing — Dampening (4) 



Dampen = 0.5 
Normal damp = 0.8 
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No damp 



Dampen = 0.5 
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Dampen = 0.5 
Normal damp = 0.8 
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Blend sharpness 

• Different transitions to the background material 
o rather blurry - mud, ice, dirt 

o rather sharp - snow, sand, grass 

• Simple to implement - just stretch the distance between some lerp coefficients (see next slide) 
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Pixel shader 


combining and dampening 


1 .Compute world space normal of a background surface ( combinedVerticaiNormai) 

2. Compute world space normal of an overlay surface ( combinedHorizontaiNormai) 

3. Measure vertex-level slope angle ( vertexsiope ) 

4. Compute a flattened version of ptl . based on vertexSIope (fiattenedCombinedVerticaiNormai) 

5. Lerp between a pt.1 and pt.4 based on SlopeBasedDamp{biasedFlattenedCombinedVerticalNormal) 


// Combine vertex normal with background / overlay material normals 

float3 combinedVerticaiNormai = CombineNormalsTangent ( vertexNormalj verticalNormal., worldTangent., worldBinormal ) m 3 
float3 combinedHorizontaiNormai = CombineNormalsTangent ( vertexNormal., horizontalNormal., worldTangent worldBinormal 


A 


// Apply dampening to the backround normal 
float vertexsiope = dot( vertexNormal., float3( 0., 1 ) 

float3 f lattenedCombinedVerticalNormal = lerp( combinedVerticaiNormai., float 3 ( 0., 0., 1 )., vertexsiope 
\j r loat3 biasedFlattenedCombinedVerticalNormal = normalize( lerp( combinedVerticaiNormai;, f lattenedCombinedVerticalNormal;, slopeBasedDamp ) )^/ 


// Compute slope tangent for the dampened background normal 

float verticalSurf aceTangent = ComputeSlopeTangent ( biasedF lattenedCombinedVerticalNormal;, slopeThreshold., 

saturate( slopeThreshold + horizontalToVerticalBlendSharpness ) ); 
float3 f ullNormalCombination = CombineNormalsDerivatives( combinedVerticaiNormai., combinedHorizontaiNormai;, 

float3( 1.0f - slopeBasedNormalDampj slopeBasedNormalDamp^ l,0f ) 


// Use slope to lerp between vertical and horizontal surface colors^ normals and material params (spec., gloss^ fallof) 

float3 finalColor = lerp( horizontalColor^ verticalColor., verticalSurf aceTangent 

float3 finalNormal = lerp( f ullNormalCombination^ combinedVerticaiNormai., verticalSurf aceTangent 
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Pixel shader — blending (+ normal dampening) 


1 .Compute tangent of the background surface ( verticaiSurfaceTangent ) 

a.linear step between slopeThreshold and (slopeThreshold + blendSharpness) 

2. Combine background and overlay normals through partial derivatives, considering 
slopeBasedNormalDamp. (fullNormalCombination) 

3. Lerp colors and normals based on verticaiSurfaceTangent. 

if Combine vertex normal with background / overlay material normals 

float3 combinedVerticalNormal = CombineNormalsTangent ( vertexNormalj verticalNormal^ woridTangent y worldBinormal )j 
float3 combinedHorizontalNormal = CombineNormalsTangent ( vertexNormal_ f horizontalNormalj worldTangent^ worldBinormal 


// Apply dampening to the backround normal 

float vertexSlope = dot( vertexNormalj float3( 6^ 0_> 1 ) )j 

float3 f lattenedCombinedVerticalNormal = lerp( combinedVerticalNormal^ float3( & 3 & 3 1 vertexSlope ) 3 

float3 biasedFlattenedCombinedVerticalNormal = normalize( lerp( combinedVerticalNormalj f lattenedCombinedVerticalNormal^ slopeBasedDamp ) 


// Compute slope tangent for the dampened background normal 

float verticaiSurfaceTangent = ComputeSlopeTangent ( biasedFlattenedCombinedVerticalNormalj slopeThreshold^ 

saturate( slopeThreshold + horizontalToVerticalBlendSharpness ) )' 3 
float3 fullNormalCombination = CombineNormalsDerivativesf combinedVerticalNormal^ combinedHorizontalNormal^ 

float3( l.ftf - slopeBasedNormalDamp^ slopeBasedNormalDamp^ l.Gf ) ) 3 


U Use slope to lerp between vertical and horizontal surface colors^ normals and material params (spec^ gloss^ fallof) 

float3 finalColor = lerp( horizontalColor^ verticalColor^ verticaiSurfaceTangent 

float3 finalNormal = lerp( f ullNormalCombination^ combinedVerticalNormal^ verticalSurf aceTangent 


A 


J 
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Assembling new textures 

• Combining textures with each other 

• Different results depending on which texture is a background 
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Must have tools 

• Freely enable/disable each component of the brush, eg.: 

o want to influence texel size only 
o want to influence threshold only 
o want to change overlay/background texture only 

• increment/decrement threshold 

• optional but very useful: value falloff on brush radius 
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Per-texture params 

• Horizontal 

o blend sharpness 

• Vertical 

o dampen color on low slopes 
o dampen normals on low slopes 

• Horizontal/Vertical 

o custom ones, eg.: falloff, roughness 
o grass brush (more about that later) 


Texture pick ( horizontal / vertical ) 


Parameters for 
g r o u n d_b r i c ks_m essy 

[H] Blend sharpness 

■ — Q 

[V] Slope-based damp 

— o 

[V] Slope-based normal damp 

■ o — 

[V/H] RSpec Scale 

Q — 

[V/H] Specularity 

Q 

[V/H] RSpec Base 

0 - 


[V/H] Fallof 



grass_mossy mountai 


grass_rocks 


rocky_clrff rocky_cli 





snow flat 
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Triplar mapping 

• No triplanar mapping for overlay texture 

• For background texture sample with 
triplanar mapping 

o Choose which planes contribute ( prefer 
branching over texture fetches ) 

• Tighten the blend zone as much as 
possible without introducing glitches 
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performance 
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Blend zone tightening 

// Compute triplanar mapping weights 

const float 3 tighten = ( f 1 o a 1 3 ) |lG H TE N_F ACTC|; 

const float3 absVertexJNormal = abs( normalize ( vertexNormal ) )j 
float3 weights = absVertexNormal - tighten^ 


RED - three samples YELLOW - two samples GREEN - one sample 
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TIGHTEN FACTOR=0.3 


TIGHTEN FACTOR=0.576 
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Terrain holes performance 

• Solutions unavailable: 

o Can’t just render terrain with “discard” instruction inside, as it disables early-Z and hi-Z. 
o Can’t manipulate indices when using hardware tessellation 
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Terrain holes - our solution 


• Know that there is a hole inside a given tessellation block 

o Determine that during vertical error clipmap update 
o Check that during hull shader processing 

• Split terrain drawcall into two drawcalls (#ifdef d shaders) 

o 1 : cull tessellation block if it contains a hole 

■ usually covers over 99% of the terrain 

■ no discard instruction - hiZ on 

o 2: draw tessellation block if it contains a hole 

■ with discard instruction 

■ best/closest clipmap level only 

// Assume that the stamp is going to need discards. 

// M5JDISCARD_PA55 is only used for level 6 patches 
#ifdef IHS_D I SCAR D_P AS S 

if ( patchCenter Errors, w == S.Sf SlSl lisInStamp ) 

#else 

if ( patchCenterErrors. w > G.Gf | | ( isInStamp && clipmapILevel == 6 ) ) 

#endif 

{ 

leftTessFactor = rightTessFactor = bottomTessFactor = topTessFactor = 



} 
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Terrain shadows 
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Terrain shadows clipmap 

• Store maximum height that’s in shadow 

• Update when streaming clipmap or changing time of day 

• Has to be tightly coupled with clipmap computations to avoid shadows shimmering 

• Allow a few huge meshes to cast terrain shadows 




GAME DEVELOPERS CONFERENCE* 2014 


MARCH 17-21, 2014 GDCONF.COM 


Terrain shadows algorithm 

1 . Lay down terrain depth - sun perspective 

2. Render to the slices of shadows clipmap 
For each texel 

o At a corresponding elevation texel, calculate a full world space position ( wsPos ) 
o For i=0 to n // n=1 3 works just fine © 

■ transform wsPos to the sun-space position 

■ compare z value of the sun-space position with the one fetched from pt.1 texture 

■ if position is occluded, increase wsPos. z by step, halve step 

■ if position is not occluded, decrease wsPos. z by step 
o Store the last z component value in the terrain shadow map 
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Terrain — memory footprint 


5 clipmap levels, 1024x1024 window size 

• elevation + normal + control map = 30 MB 

• color map = 12 MB 

• vertical errors map = 327 KB 

• shadow map = 1 0 MB 

+10 for meshes casting terrain shadows 


= ~53 ( 63) MB 


+ Texture Arrays 
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Vegetation - overview 

• Using SpeedTree Forest library for culling and LODing 

o Shared culling grid for all tree types 
o Separate culling grid per grass type (grass layer) 

■ various cell sizes and draw distances 

• Track grass visibility cells as they come in and out of view 

o Populate newly visible cells in two steps: 

■ pass prebaked instances 

■ generate and append dynamic ones 
o Update instance buffers 

• Introduce a vegetation brush resource 

o wraps a set of vegetation types along with their densities and scales/scale vars. 
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Grass/debris - goals 

• Distribute procedurally because 

o . . . instances take a lot of memory 
o . . . painting takes a lot of time 

• Match terrain material 

• Make it look diverse 

• Allow for masking out 

• Make it fast 

o CPU or GPU? 
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Grass/debris — distribution overview (1) 

• Assign brushes to terrain materials 

o grass types from those brushes become auto-distributed 
o many to many relation 
o ~10 types are auto-distributed on our levels 

• When a grass cell comes into view, lookup the prebaked occurrence map 

o each auto-distributed grass type has one 
o if bit is not set -> skip the cell processing 
o 125kB per map given 100 m 2 cell size on a 10km 2 world 
o Skips almost all the work compared to the uncooked game 
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Grass/debris — distribution overview (2) 

• For a given cell, perform a number of iterations 

o pick a spot within cell’s bounds 

o verify if the type is assigned there 

o compute background/overlay visibility for that spot 

■ replicates terrain PS behaviour, but with vertex-level precision 
o consume the amount of “attempts” based on brush settings 

• Optimize by rendering a grass map after a clipmap update 

o fetch instead of the normal map and avoid most of the computation 
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Grass doesn't „sit" on the terrain 


• Conventional problem of grass standing out visually 
o Takes a lot of artist’s time to hide it 
o Critical when populating procedurally 



what we have 


what we want 



GAME DEVELOPERS CONFERENCE* 2014 


Pigment map 

• Render top-down view of the terrain 
o 1’st clipmap level (closest area) 
o Use lowest mipmaps 
o No interpolation 
o No triplanar mapping 
o Account for color map 
o No tessellation - just one huge quad 
■ provided that pregenerated normal 
maps are enabled 
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Pigment map (2) 


Colorize instances by sampling pigment 
map in vertex shader 

• Bottom-up falloff, adjustable per type 

• Slightly less for close instances 

• Slightly more for far instances 

• Exclude some types (eg.: heather) 
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Grass/debris — tool 

• Assign a brush to the material 

• Ignore non-grass types 

• Account for density, scale, scale var. 


MARCH 17-21, 2014 GDCONF.COM 







GAME DEVELOPERS CONFERENCE* 2014 


MARCH 17-21, 2014 GDCONF.COM 


Grass/debris — reminder 

• The technique doesn’t exceed the cost of 1ms when running in a cooked game 

• Hits the editor performance badly when going overboard with the amount of auto-distributed grass 
types 

• Users must be able to mask some areas out 

o currently we have a separate mask for that 
o will use occurrence map in a cooked game 

• A thing to try: move the distribution to the GPU 

o eg.: run it on a compute shader with limited resources, while processing draw calls 
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Vegetation generator 

• Offline tool, not limited to grass and debris 

• Can populate the whole level or chosen contiguous areas 

• Simulates water accumulation and light distribution 
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Vegetation generator tool 



Alive cells: 0 

Pick area! 


Initial settings Populatio rT | Energy | Color 


Density 

1 10 100 

rg- 


Water resources 
0 700 1500 

i — cr 


Set before starting Preset: 
the iterations. 


default 


List of plant models: 


a bie s_com monjow 
abies common lowest 


abies common medium 


a bie s_com mon_bige st 
a bie s_com mon_big 


Range: 

150 


45 


r 


Plant type: 

@ Tree 
© Low tree 
© Bush 
© Low Bush 
© Grass 



Initial settings 


Population 


Energy 


Color 


Min slope limit 
0 0 90 

cr 


Max slope limit 
1 45 90 

~V~ 


Additional cells 
0 0 12 
cr 


Initial settings Population 


Energy 


Color 


Sun energy 
0 100 600 
rcr 


Growth energy 

1 20 400 

u - 


Transfer energy 
0 0 500 

cr 


Initial settings Population Energy 


Sun Energy Color 
0 0 100 
cr 


Ambient Occlusion 
0 50 100 

i — cr 


Color 


AO Spread 
1 250 1000 


Distribution speed 
0 29 


Seed energy 
200 1100 2000 
i — cr 


Bake 


Bake colors / ao into 
distributed vegetation. 





GAME DEVELOPERS CONFERENCE* 2014 


MARCH 17-21, 2014 GDCONF.COM 


Vegetation generator algorithm 

• For the whole region, allocate a 2d array of “resource” values. 

• Perform a number of following iterations: 

o For each cell, check the cell and it’s neighbours elevations 
o Compute the slopes to/from neighbours, and decrease/increase resource values 
(sedimentation of resources) 

• For all cells 

o Check the trajectory of the sun and compute the percentage of time when the cell is in 
shadow. Compare this value with values assigned to vegetation types to filter them out (for that 
cell) 

o If the cell’s resource value is bigger than some threshold, then pick a vegetation type, and 
spawn it. 

■ Additionally scale the object based on how it’s environment matches “perfect conditions”, 
namely the amount of resource and sunlight 
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Stamp tool 

• Photoshop-style 

• Copy-paste with full package 

o elevation, control map, color map, vegetation 
o rotating, scaling, paste-combining 
o real-time preview 

• Allow saving/loading stamps 

• Became the most popular tool! 
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Workflow 

• Import the terrain from World Machine. 

• Select any area to export, process, and import back. 

o Done very rarely since stamp tool reached polished stage. 

• Edit mostly with stamps. 

o Artists move away from rise/lower tool 

■ They keep a set of stamps, with different landscape characteristics. 

■ It’s critical to make this tool robust, ergonomic, real-time, have undo for it, etc. but it pays off. 

■ Falling back to rise/lower for quest fine-tuning purposes mostly. 

• Painting grass manually only in selected areas 

o some intensive action/cutscene/dialogue zone 

o when applying knowledge about relations between foliage types for a more convincing result 

• Run vegetation generator iterations for chosen areas. 

o Settings are easy to reapply for given area, so redesigning some area is not a big problem. 

• When in need to manually place grass and debris, mask out the automatic one. 
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Thanks to the team!! 

PROGRAMMERS 

Adam Cichocki (Pigment map) 

Przemek Czatrowski (Color map, Stamp preview, tools) 

Tim Green ( Stamp, tools) 

Tomasz Jonarski (Shadow map) 

Krzysztof Krzyscin (Vegetation Generator) 

Konstantinos Michalopoulos (tools) 

ARTISTS 

Michaf Buczkowski 
Marcin Michalski 
Daniel Olejnik 


(in alphabetical order) 
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